Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add b200 policies for reduce #3612

Merged
merged 2 commits into from
Jan 31, 2025
Merged

Add b200 policies for reduce #3612

merged 2 commits into from
Jan 31, 2025

Conversation

bernhardmgruber
Copy link
Contributor

No description provided.

@bernhardmgruber bernhardmgruber requested a review from a team as a code owner January 30, 2025 15:55
@github-actions GitHub Actions
Copy link
Contributor

🟩 CI finished in 2h 16m: Pass: 100%/89 | Total: 2d 14h | Avg: 41m 54s | Max: 1h 13m | Hits: 274%/10936

  • 🟩 cub: Pass: 100%/44 | Total: 1d 14h | Avg: 52m 49s | Max: 1h 13m | Hits: 363%/3552 

    🟩 cpu
  🟩 amd64              Pass: 100%/42  | Total:  1d 12h | Avg: 52m 22s | Max:  1h 13m | Hits: 363%/3552  
  🟩 arm64              Pass: 100%/2   | Total:  2h 05m | Avg:  1h 02m | Max:  1h 03m
🟩 ctk
  🟩 12.0               Pass: 100%/5   | Total:  5h 06m | Avg:  1h 01m | Max:  1h 07m | Hits: 363%/888   
  🟩 12.5               Pass: 100%/2   | Total:  2h 19m | Avg:  1h 09m | Max:  1h 10m
  🟩 12.6               Pass: 100%/37  | Total:  1d 07h | Avg: 50m 45s | Max:  1h 13m | Hits: 363%/2664  
🟩 cudacxx
  🟩 ClangCUDA18        Pass: 100%/2   | Total:  1h 56m | Avg: 58m 11s | Max: 59m 00s
  🟩 nvcc12.0           Pass: 100%/5   | Total:  5h 06m | Avg:  1h 01m | Max:  1h 07m | Hits: 363%/888   
  🟩 nvcc12.5           Pass: 100%/2   | Total:  2h 19m | Avg:  1h 09m | Max:  1h 10m
  🟩 nvcc12.6           Pass: 100%/35  | Total:  1d 05h | Avg: 50m 20s | Max:  1h 13m | Hits: 363%/2664  
🟩 cudacxx_family
  🟩 ClangCUDA          Pass: 100%/2   | Total:  1h 56m | Avg: 58m 11s | Max: 59m 00s
  🟩 nvcc               Pass: 100%/42  | Total:  1d 12h | Avg: 52m 34s | Max:  1h 13m | Hits: 363%/3552  
🟩 cxx
  🟩 Clang14            Pass: 100%/4   | Total:  3h 44m | Avg: 56m 04s | Max:  1h 00m
  🟩 Clang15            Pass: 100%/2   | Total:  1h 49m | Avg: 54m 41s | Max: 57m 12s
  🟩 Clang16            Pass: 100%/2   | Total:  1h 53m | Avg: 56m 54s | Max: 59m 10s
  🟩 Clang17            Pass: 100%/2   | Total:  2h 11m | Avg:  1h 05m | Max:  1h 07m
  🟩 Clang18            Pass: 100%/7   | Total:  5h 36m | Avg: 48m 05s | Max:  1h 01m
  🟩 GCC7               Pass: 100%/2   | Total:  2h 09m | Avg:  1h 04m | Max:  1h 09m
  🟩 GCC8               Pass: 100%/1   | Total: 53m 19s | Avg: 53m 19s | Max: 53m 19s
  🟩 GCC9               Pass: 100%/2   | Total:  1h 59m | Avg: 59m 58s | Max:  1h 01m
  🟩 GCC10              Pass: 100%/2   | Total:  1h 55m | Avg: 57m 31s | Max: 59m 23s
  🟩 GCC11              Pass: 100%/2   | Total:  1h 54m | Avg: 57m 20s | Max:  1h 01m
  🟩 GCC12              Pass: 100%/4   | Total:  2h 55m | Avg: 43m 59s | Max:  1h 02m
  🟩 GCC13              Pass: 100%/8   | Total:  4h 42m | Avg: 35m 18s | Max:  1h 03m
  🟩 MSVC14.29          Pass: 100%/2   | Total:  2h 14m | Avg:  1h 07m | Max:  1h 07m | Hits: 363%/1776  
  🟩 MSVC14.39          Pass: 100%/2   | Total:  2h 23m | Avg:  1h 11m | Max:  1h 13m | Hits: 364%/1776  
  🟩 NVHPC24.7          Pass: 100%/2   | Total:  2h 19m | Avg:  1h 09m | Max:  1h 10m
🟩 cxx_family
  🟩 Clang              Pass: 100%/17  | Total: 15h 15m | Avg: 53m 51s | Max:  1h 07m
  🟩 GCC                Pass: 100%/21  | Total: 16h 31m | Avg: 47m 11s | Max:  1h 09m
  🟩 MSVC               Pass: 100%/4   | Total:  4h 38m | Avg:  1h 09m | Max:  1h 13m | Hits: 363%/3552  
  🟩 NVHPC              Pass: 100%/2   | Total:  2h 19m | Avg:  1h 09m | Max:  1h 10m
🟩 gpu
  🟩 h100               Pass: 100%/2   | Total: 56m 15s | Avg: 28m 07s | Max: 29m 12s
  🟩 rtxa6000           Pass: 100%/8   | Total:  4h 05m | Avg: 30m 40s | Max: 58m 30s
  🟩 v100               Pass: 100%/34  | Total:  1d 09h | Avg: 59m 30s | Max:  1h 13m | Hits: 363%/3552  
🟩 jobs
  🟩 Build              Pass: 100%/37  | Total:  1d 12h | Avg: 58m 26s | Max:  1h 13m | Hits: 363%/3552  
  🟩 DeviceLaunch       Pass: 100%/1   | Total: 20m 46s | Avg: 20m 46s | Max: 20m 46s
  🟩 GraphCapture       Pass: 100%/1   | Total: 17m 20s | Avg: 17m 20s | Max: 17m 20s
  🟩 HostLaunch         Pass: 100%/3   | Total:  1h 21m | Avg: 27m 00s | Max: 29m 12s
  🟩 TestGPU            Pass: 100%/2   | Total: 43m 29s | Avg: 21m 44s | Max: 22m 02s
🟩 sm
  🟩 90                 Pass: 100%/2   | Total: 56m 15s | Avg: 28m 07s | Max: 29m 12s
  🟩 90a                Pass: 100%/1   | Total: 24m 51s | Avg: 24m 51s | Max: 24m 51s
🟩 std
  🟩 17                 Pass: 100%/20  | Total: 20h 13m | Avg:  1h 00m | Max:  1h 10m | Hits: 364%/2664  
  🟩 20                 Pass: 100%/24  | Total: 18h 31m | Avg: 46m 18s | Max:  1h 13m | Hits: 362%/888

  • 🟩 thrust: Pass: 100%/42 | Total: 22h 46m | Avg: 32m 32s | Max: 1h 02m | Hits: 231%/7384 

    🟩 cmake_options
  🟩 -DTHRUST_DISPATCH_TYPE=Force32bit Pass: 100%/2   | Total: 47m 21s | Avg: 23m 40s | Max: 33m 19s
🟩 cpu
  🟩 amd64              Pass: 100%/40  | Total: 21h 44m | Avg: 32m 36s | Max:  1h 02m | Hits: 231%/7384  
  🟩 arm64              Pass: 100%/2   | Total:  1h 02m | Avg: 31m 16s | Max: 33m 02s
🟩 ctk
  🟩 12.0               Pass: 100%/5   | Total:  3h 02m | Avg: 36m 31s | Max: 53m 08s | Hits: 228%/1846  
  🟩 12.5               Pass: 100%/2   | Total:  1h 47m | Avg: 53m 33s | Max: 55m 43s
  🟩 12.6               Pass: 100%/35  | Total: 17h 56m | Avg: 30m 46s | Max:  1h 02m | Hits: 232%/5538  
🟩 cudacxx
  🟩 ClangCUDA18        Pass: 100%/2   | Total: 50m 02s | Avg: 25m 01s | Max: 25m 01s
  🟩 nvcc12.0           Pass: 100%/5   | Total:  3h 02m | Avg: 36m 31s | Max: 53m 08s | Hits: 228%/1846  
  🟩 nvcc12.5           Pass: 100%/2   | Total:  1h 47m | Avg: 53m 33s | Max: 55m 43s
  🟩 nvcc12.6           Pass: 100%/33  | Total: 17h 06m | Avg: 31m 07s | Max:  1h 02m | Hits: 232%/5538  
🟩 cudacxx_family
  🟩 ClangCUDA          Pass: 100%/2   | Total: 50m 02s | Avg: 25m 01s | Max: 25m 01s
  🟩 nvcc               Pass: 100%/40  | Total: 21h 56m | Avg: 32m 54s | Max:  1h 02m | Hits: 231%/7384  
🟩 cxx
  🟩 Clang14            Pass: 100%/4   | Total:  2h 12m | Avg: 33m 05s | Max: 38m 50s
  🟩 Clang15            Pass: 100%/2   | Total:  1h 08m | Avg: 34m 18s | Max: 36m 49s
  🟩 Clang16            Pass: 100%/2   | Total:  1h 03m | Avg: 31m 55s | Max: 33m 06s
  🟩 Clang17            Pass: 100%/2   | Total: 59m 29s | Avg: 29m 44s | Max: 30m 16s
  🟩 Clang18            Pass: 100%/7   | Total:  2h 37m | Avg: 22m 27s | Max: 30m 43s
  🟩 GCC7               Pass: 100%/2   | Total:  1h 03m | Avg: 31m 37s | Max: 33m 11s
  🟩 GCC8               Pass: 100%/1   | Total: 32m 41s | Avg: 32m 41s | Max: 32m 41s
  🟩 GCC9               Pass: 100%/2   | Total:  1h 09m | Avg: 34m 58s | Max: 35m 59s
  🟩 GCC10              Pass: 100%/2   | Total:  1h 02m | Avg: 31m 17s | Max: 32m 03s
  🟩 GCC11              Pass: 100%/2   | Total:  1h 03m | Avg: 31m 45s | Max: 32m 49s
  🟩 GCC12              Pass: 100%/2   | Total:  1h 03m | Avg: 31m 55s | Max: 32m 29s
  🟩 GCC13              Pass: 100%/8   | Total:  3h 02m | Avg: 22m 45s | Max: 33m 19s
  🟩 MSVC14.29          Pass: 100%/2   | Total:  1h 55m | Avg: 57m 51s | Max:  1h 02m | Hits: 228%/3692  
  🟩 MSVC14.39          Pass: 100%/2   | Total:  2h 04m | Avg:  1h 02m | Max:  1h 02m | Hits: 234%/3692  
  🟩 NVHPC24.7          Pass: 100%/2   | Total:  1h 47m | Avg: 53m 33s | Max: 55m 43s
🟩 cxx_family
  🟩 Clang              Pass: 100%/17  | Total:  8h 01m | Avg: 28m 19s | Max: 38m 50s
  🟩 GCC                Pass: 100%/19  | Total:  8h 57m | Avg: 28m 18s | Max: 35m 59s
  🟩 MSVC               Pass: 100%/4   | Total:  4h 00m | Avg:  1h 00m | Max:  1h 02m | Hits: 231%/7384  
  🟩 NVHPC              Pass: 100%/2   | Total:  1h 47m | Avg: 53m 33s | Max: 55m 43s
🟩 gpu
  🟩 rtx4090            Pass: 100%/8   | Total:  2h 25m | Avg: 18m 14s | Max: 33m 19s
  🟩 v100               Pass: 100%/34  | Total: 20h 20m | Avg: 35m 54s | Max:  1h 02m | Hits: 231%/7384  
🟩 jobs
  🟩 Build              Pass: 100%/37  | Total: 21h 55m | Avg: 35m 33s | Max:  1h 02m | Hits: 231%/7384  
  🟩 TestCPU            Pass: 100%/2   | Total: 15m 24s | Avg:  7m 42s | Max:  7m 48s
  🟩 TestGPU            Pass: 100%/3   | Total: 35m 51s | Avg: 11m 57s | Max: 14m 02s
🟩 sm
  🟩 90a                Pass: 100%/1   | Total: 19m 50s | Avg: 19m 50s | Max: 19m 50s
🟩 std
  🟩 17                 Pass: 100%/20  | Total: 12h 15m | Avg: 36m 47s | Max:  1h 02m | Hits: 232%/5538  
  🟩 20                 Pass: 100%/20  | Total:  9h 43m | Avg: 29m 10s | Max:  1h 02m | Hits: 228%/1846

  • 🟩 cccl_c_parallel: Pass: 100%/2 | Total: 7m 36s | Avg: 3m 48s | Max: 5m 32s

     
    🟩 cpu
  🟩 amd64              Pass: 100%/2   | Total:  7m 36s | Avg:  3m 48s | Max:  5m 32s
🟩 ctk
  🟩 12.6               Pass: 100%/2   | Total:  7m 36s | Avg:  3m 48s | Max:  5m 32s
🟩 cudacxx
  🟩 nvcc12.6           Pass: 100%/2   | Total:  7m 36s | Avg:  3m 48s | Max:  5m 32s
🟩 cudacxx_family
  🟩 nvcc               Pass: 100%/2   | Total:  7m 36s | Avg:  3m 48s | Max:  5m 32s
🟩 cxx
  🟩 GCC13              Pass: 100%/2   | Total:  7m 36s | Avg:  3m 48s | Max:  5m 32s
🟩 cxx_family
  🟩 GCC                Pass: 100%/2   | Total:  7m 36s | Avg:  3m 48s | Max:  5m 32s
🟩 gpu
  🟩 rtx2080            Pass: 100%/2   | Total:  7m 36s | Avg:  3m 48s | Max:  5m 32s
🟩 jobs
  🟩 Build              Pass: 100%/1   | Total:  2m 04s | Avg:  2m 04s | Max:  2m 04s
  🟩 Test               Pass: 100%/1   | Total:  5m 32s | Avg:  5m 32s | Max:  5m 32s

  • 🟩 python: Pass: 100%/1 | Total: 30m 21s | Avg: 30m 21s | Max: 30m 21s

     
    🟩 cpu
  🟩 amd64              Pass: 100%/1   | Total: 30m 21s | Avg: 30m 21s | Max: 30m 21s
🟩 ctk
  🟩 12.6               Pass: 100%/1   | Total: 30m 21s | Avg: 30m 21s | Max: 30m 21s
🟩 cudacxx
  🟩 nvcc12.6           Pass: 100%/1   | Total: 30m 21s | Avg: 30m 21s | Max: 30m 21s
🟩 cudacxx_family
  🟩 nvcc               Pass: 100%/1   | Total: 30m 21s | Avg: 30m 21s | Max: 30m 21s
🟩 cxx
  🟩 GCC13              Pass: 100%/1   | Total: 30m 21s | Avg: 30m 21s | Max: 30m 21s
🟩 cxx_family
  🟩 GCC                Pass: 100%/1   | Total: 30m 21s | Avg: 30m 21s | Max: 30m 21s
🟩 gpu
  🟩 rtx2080            Pass: 100%/1   | Total: 30m 21s | Avg: 30m 21s | Max: 30m 21s
🟩 jobs
  🟩 Test               Pass: 100%/1   | Total: 30m 21s | Avg: 30m 21s | Max: 30m 21s

👃 Inspect Changes

Modifications in project?

Project
CCCL Infrastructure
libcu++
+/- CUB
Thrust
CUDA Experimental
python
CCCL C Parallel Library
Catch2Helper

Modifications in project or dependencies?

Project
CCCL Infrastructure
libcu++
+/- CUB
+/- Thrust
CUDA Experimental
+/- python
+/- CCCL C Parallel Library
+/- Catch2Helper

🏃‍ Runner counts (total jobs: 89)
# Runner
65 linux-amd64-cpu16
8 windows-amd64-cpu16
6 linux-amd64-gpu-rtxa6000-latest-1
4 linux-arm64-cpu16
3 linux-amd64-gpu-rtx4090-latest-1
2 linux-amd64-gpu-rtx2080-latest-1
1 linux-amd64-gpu-h100-latest-1

@miscco miscco merged commit de1c340 into NVIDIA:main Jan 31, 2025
104 of 108 checks passed
@github-actions GitHub Actions
Copy link
Contributor

Git push to origin failed for branch/2.8.x with exitcode 128

@bernhardmgruber bernhardmgruber deleted the tune_reduce branch January 31, 2025 09:34
@gonidelis
Copy link
Member

reduce.sum (only I64/F64 give speedups)

|  T{ct}  |  OffsetT{ct}  |  Elements{io}  |   Ref Time |   Ref Noise |   Cmp Time |   Cmp Noise |      Diff |   %Diff |  Status  |
|---------|---------------|----------------|------------|-------------|------------|-------------|-----------|---------|----------|
|   I8    |      I32      |      2^16      |  11.303 us |       1.91% |  11.303 us |       1.90% |  0.000 us |   0.00% |   SAME   |
|   I8    |      I32      |      2^20      |  11.291 us |       2.49% |  11.322 us |       2.74% |  0.031 us |   0.28% |   SAME   |
|   I8    |      I32      |      2^24      |  15.397 us |       1.33% |  15.405 us |       1.42% |  0.008 us |   0.05% |   SAME   |
|   I8    |      I32      |      2^28      |  64.596 us |       0.65% |  64.560 us |       0.78% | -0.036 us |  -0.06% |   SAME   |
|   I8    |      I64      |      2^16      |  11.295 us |       1.68% |  11.298 us |       1.88% |  0.002 us |   0.02% |   SAME   |
|   I8    |      I64      |      2^20      |  11.282 us |       1.72% |  11.288 us |       1.79% |  0.006 us |   0.05% |   SAME   |
|   I8    |      I64      |      2^24      |  15.387 us |       1.04% |  15.402 us |       1.35% |  0.015 us |   0.10% |   SAME   |
|   I8    |      I64      |      2^28      |  64.716 us |       0.94% |  64.709 us |       0.94% | -0.007 us |  -0.01% |   SAME   |
|   I16   |      I32      |      2^16      |  11.296 us |       1.80% |  11.297 us |       1.67% |  0.001 us |   0.01% |   SAME   |
|   I16   |      I32      |      2^20      |  11.519 us |       5.75% |  11.531 us |       5.74% |  0.013 us |   0.11% |   SAME   |
|   I16   |      I32      |      2^24      |  17.597 us |       3.19% |  17.555 us |       2.88% | -0.042 us |  -0.24% |   SAME   |
|   I16   |      I32      |      2^28      | 103.719 us |       0.70% | 103.747 us |       0.73% |  0.028 us |   0.03% |   SAME   |
|   I16   |      I64      |      2^16      |  11.343 us |       2.61% |  11.269 us |       0.68% | -0.075 us |  -0.66% |   SAME   |
|   I16   |      I64      |      2^20      |  11.478 us |       5.09% |  11.546 us |       5.95% |  0.069 us |   0.60% |   SAME   |
|   I16   |      I64      |      2^24      |  17.647 us |       3.53% |  17.510 us |       2.61% | -0.137 us |  -0.77% |   SAME   |
|   I16   |      I64      |      2^28      | 103.347 us |       0.44% | 103.299 us |       0.53% | -0.048 us |  -0.05% |   SAME   |
|   I32   |      I32      |      2^16      |  11.299 us |       1.80% |  11.297 us |       1.60% | -0.002 us |  -0.02% |   SAME   |
|   I32   |      I32      |      2^20      |  12.491 us |       7.83% |  12.513 us |       7.92% |  0.022 us |   0.18% |   SAME   |
|   I32   |      I32      |      2^24      |  23.957 us |       3.28% |  23.813 us |       2.74% | -0.144 us |  -0.60% |   SAME   |
|   I32   |      I32      |      2^28      | 177.187 us |       0.43% | 177.285 us |       0.43% |  0.098 us |   0.06% |   SAME   |
|   I32   |      I64      |      2^16      |  11.318 us |       2.05% |  11.312 us |       1.91% | -0.007 us |  -0.06% |   SAME   |
|   I32   |      I64      |      2^20      |  12.974 us |       6.11% |  12.841 us |       7.12% | -0.133 us |  -1.03% |   SAME   |
|   I32   |      I64      |      2^24      |  23.955 us |       3.39% |  23.807 us |       2.68% | -0.147 us |  -0.61% |   SAME   |
|   I32   |      I64      |      2^28      | 177.270 us |       0.47% | 177.254 us |       0.45% | -0.016 us |  -0.01% |   SAME   |
|   I64   |      I32      |      2^16      |  11.306 us |       2.08% |  11.309 us |       2.23% |  0.003 us |   0.02% |   SAME   |
|   I64   |      I32      |      2^20      |  13.343 us |       1.69% |  13.494 us |       4.05% |  0.151 us |   1.13% |   SAME   |
|   I64   |      I32      |      2^24      |  38.519 us |       2.44% |  36.334 us |       2.46% | -2.185 us |  -5.67% |   FAST   |
|   I64   |      I32      |      2^28      | 323.474 us |       0.53% | 321.234 us |       0.48% | -2.240 us |  -0.69% |   FAST   |
|   I64   |      I64      |      2^16      |  11.286 us |       1.52% |  11.358 us |       2.72% |  0.072 us |   0.64% |   SAME   |
|   I64   |      I64      |      2^20      |  13.315 us |       0.75% |  13.386 us |       2.72% |  0.071 us |   0.54% |   SAME   |
|   I64   |      I64      |      2^24      |  38.572 us |       2.49% |  36.433 us |       2.52% | -2.139 us |  -5.55% |   FAST   |
|   I64   |      I64      |      2^28      | 323.277 us |       0.51% | 322.354 us |       0.34% | -0.923 us |  -0.29% |   SAME   |
|  I128   |      I32      |      2^16      |  11.385 us |       4.04% |  11.363 us |       3.33% | -0.022 us |  -0.20% |   SAME   |
|  I128   |      I32      |      2^20      |  15.401 us |       1.28% |  15.402 us |       1.21% |  0.002 us |   0.01% |   SAME   |
|  I128   |      I32      |      2^24      |  64.234 us |       2.18% |  64.314 us |       2.15% |  0.080 us |   0.12% |   SAME   |
|  I128   |      I32      |      2^28      | 620.679 us |       0.25% | 620.837 us |       0.25% |  0.158 us |   0.03% |   SAME   |
|  I128   |      I64      |      2^16      |  11.509 us |       4.47% |  11.499 us |       4.73% | -0.009 us |  -0.08% |   SAME   |
|  I128   |      I64      |      2^20      |  15.397 us |       1.27% |  15.405 us |       1.24% |  0.008 us |   0.06% |   SAME   |
|  I128   |      I64      |      2^24      |  64.359 us |       2.04% |  64.341 us |       2.05% | -0.018 us |  -0.03% |   SAME   |
|  I128   |      I64      |      2^28      | 621.447 us |       0.25% | 621.519 us |       0.26% |  0.072 us |   0.01% |   SAME   |
|   F32   |      I32      |      2^16      |  11.439 us |       3.71% |  11.455 us |       3.78% |  0.016 us |   0.14% |   SAME   |
|   F32   |      I32      |      2^20      |  12.791 us |       7.11% |  12.931 us |       6.34% |  0.140 us |   1.09% |   SAME   |
|   F32   |      I32      |      2^24      |  24.006 us |       3.46% |  24.101 us |       3.76% |  0.094 us |   0.39% |   SAME   |
|   F32   |      I32      |      2^28      | 177.429 us |       0.44% | 177.426 us |       0.85% | -0.002 us |  -0.00% |   SAME   |
|   F32   |      I64      |      2^16      |  11.299 us |       1.68% |  11.324 us |       2.13% |  0.025 us |   0.22% |   SAME   |
|   F32   |      I64      |      2^20      |  13.047 us |       5.53% |  13.097 us |       5.61% |  0.049 us |   0.38% |   SAME   |
|   F32   |      I64      |      2^24      |  24.006 us |       3.49% |  24.065 us |       3.58% |  0.059 us |   0.25% |   SAME   |
|   F32   |      I64      |      2^28      | 177.445 us |       0.43% | 177.355 us |       0.43% | -0.090 us |  -0.05% |   SAME   |
|   F64   |      I32      |      2^16      |  11.289 us |       1.52% |  11.292 us |       1.56% |  0.002 us |   0.02% |   SAME   |
|   F64   |      I32      |      2^20      |  13.345 us |       1.50% |  13.528 us |       4.29% |  0.184 us |   1.38% |   SAME   |
|   F64   |      I32      |      2^24      |  38.533 us |       2.46% |  36.445 us |       2.50% | -2.088 us |  -5.42% |   FAST   |
|   F64   |      I32      |      2^28      | 323.732 us |       0.56% | 321.791 us |       0.36% | -1.941 us |  -0.60% |   FAST   |
|   F64   |      I64      |      2^16      |  11.302 us |       1.87% |  11.302 us |       2.17% |  0.000 us |   0.00% |   SAME   |
|   F64   |      I64      |      2^20      |  13.319 us |       0.82% |  13.615 us |       4.82% |  0.296 us |   2.22% |   SLOW   |
|   F64   |      I64      |      2^24      |  38.545 us |       2.44% |  36.648 us |       2.80% | -1.897 us |  -4.92% |   FAST   |
|   F64   |      I64      |      2^28      | 323.737 us |       0.52% | 322.254 us |       0.37% | -1.484 us |  -0.46% |   FAST   |
|   C64   |      I32      |      2^16      |  11.303 us |       1.82% |  11.321 us |       2.23% |  0.019 us |   0.16% |   SAME   |
|   C64   |      I32      |      2^20      |  13.337 us |       1.77% |  13.464 us |       3.94% |  0.127 us |   0.95% |   SAME   |
|   C64   |      I32      |      2^24      |  38.506 us |       2.42% |  36.425 us |       2.55% | -2.081 us |  -5.40% |   FAST   |
|   C64   |      I32      |      2^28      | 327.870 us |       0.64% | 321.730 us |       0.36% | -6.140 us |  -1.87% |   FAST   |
|   C64   |      I64      |      2^16      |  11.289 us |       1.77% |  11.288 us |       1.08% | -0.001 us |  -0.01% |   SAME   |
|   C64   |      I64      |      2^20      |  13.427 us |       2.34% |  13.464 us |       3.68% |  0.037 us |   0.27% |   SAME   |
|   C64   |      I64      |      2^24      |  38.448 us |       2.35% |  36.542 us |       2.76% | -1.906 us |  -4.96% |   FAST   |
|   C64   |      I64      |      2^28      | 322.746 us |       0.46% | 322.111 us |       0.40% | -0.635 us |  -0.20% |   SAME   |

@gonidelis
Copy link
Member

reduce.min (no perf speedup achieved)


|  T{ct}  |  OffsetT{ct}  |  Elements{io}  |   Ref Time |   Ref Noise |   Cmp Time |   Cmp Noise |      Diff |   %Diff |  Status  |
|---------|---------------|----------------|------------|-------------|------------|-------------|-----------|---------|----------|
|   I8    |      I32      |      2^16      |  11.291 us |       1.88% |  11.329 us |       1.67% |  0.038 us |   0.33% |   SAME   |
|   I8    |      I32      |      2^20      |  11.312 us |       2.63% |  11.272 us |       3.41% | -0.040 us |  -0.36% |   SAME   |
|   I8    |      I32      |      2^24      |  15.978 us |       5.93% |  15.674 us |       4.06% | -0.304 us |  -1.90% |   SAME   |
|   I8    |      I32      |      2^28      |  66.118 us |       1.30% |  65.923 us |       1.43% | -0.195 us |  -0.30% |   SAME   |
|   I8    |      I64      |      2^16      |  11.327 us |       2.12% |  11.348 us |       1.88% |  0.022 us |   0.19% |   SAME   |
|   I8    |      I64      |      2^20      |  11.332 us |       2.71% |  11.307 us |       2.29% | -0.025 us |  -0.22% |   SAME   |
|   I8    |      I64      |      2^24      |  16.013 us |       5.96% |  15.641 us |       3.79% | -0.372 us |  -2.32% |   SAME   |
|   I8    |      I64      |      2^28      |  66.000 us |       1.44% |  65.796 us |       1.51% | -0.204 us |  -0.31% |   SAME   |
|   I16   |      I32      |      2^16      |  11.308 us |       2.02% |  11.317 us |       1.80% |  0.009 us |   0.08% |   SAME   |
|   I16   |      I32      |      2^20      |  11.647 us |       6.82% |  11.495 us |       4.93% | -0.152 us |  -1.31% |   SAME   |
|   I16   |      I32      |      2^24      |  17.558 us |       3.10% |  17.575 us |       2.48% |  0.017 us |   0.10% |   SAME   |
|   I16   |      I32      |      2^28      | 103.795 us |       0.78% | 103.720 us |       0.68% | -0.075 us |  -0.07% |   SAME   |
|   I16   |      I64      |      2^16      |  11.262 us |       0.75% |  11.298 us |       1.49% |  0.036 us |   0.32% |   SAME   |
|   I16   |      I64      |      2^20      |  11.801 us |       7.37% |  11.523 us |       5.14% | -0.278 us |  -2.36% |   SAME   |
|   I16   |      I64      |      2^24      |  17.463 us |       1.85% |  17.566 us |       2.70% |  0.103 us |   0.59% |   SAME   |
|   I16   |      I64      |      2^28      | 102.332 us |       1.15% | 102.287 us |       1.26% | -0.045 us |  -0.04% |   SAME   |
|   I32   |      I32      |      2^16      |  11.307 us |       1.64% |  11.339 us |       1.99% |  0.032 us |   0.28% |   SAME   |
|   I32   |      I32      |      2^20      |  12.485 us |       7.94% |  12.489 us |       7.53% |  0.004 us |   0.04% |   SAME   |
|   I32   |      I32      |      2^24      |  23.811 us |       2.75% |  23.828 us |       2.37% |  0.017 us |   0.07% |   SAME   |
|   I32   |      I32      |      2^28      | 177.320 us |       0.46% | 177.260 us |       0.43% | -0.060 us |  -0.03% |   SAME   |
|   I32   |      I64      |      2^16      |  11.301 us |       1.58% |  11.384 us |       2.44% |  0.083 us |   0.73% |   SAME   |
|   I32   |      I64      |      2^20      |  12.869 us |       7.18% |  12.421 us |       8.01% | -0.448 us |  -3.48% |   SAME   |
|   I32   |      I64      |      2^24      |  23.908 us |       3.11% |  23.826 us |       2.28% | -0.083 us |  -0.35% |   SAME   |
|   I32   |      I64      |      2^28      | 177.397 us |       0.48% | 177.333 us |       0.48% | -0.064 us |  -0.04% |   SAME   |
|   I64   |      I32      |      2^16      |  11.326 us |       2.34% |  11.355 us |       2.28% |  0.029 us |   0.26% |   SAME   |
|   I64   |      I32      |      2^20      |  13.346 us |       1.77% |  13.241 us |       2.80% | -0.105 us |  -0.78% |   SAME   |
|   I64   |      I32      |      2^24      |  38.576 us |       2.48% |  38.435 us |       2.10% | -0.142 us |  -0.37% |   SAME   |
|   I64   |      I32      |      2^28      | 323.966 us |       0.52% | 323.808 us |       0.54% | -0.158 us |  -0.05% |   SAME   |
|   I64   |      I64      |      2^16      |  11.339 us |       2.18% |  11.365 us |       2.54% |  0.026 us |   0.23% |   SAME   |
|   I64   |      I64      |      2^20      |  13.324 us |       0.93% |  13.316 us |       2.40% | -0.008 us |  -0.06% |   SAME   |
|   I64   |      I64      |      2^24      |  38.612 us |       2.51% |  38.453 us |       2.21% | -0.160 us |  -0.41% |   SAME   |
|   I64   |      I64      |      2^28      | 324.549 us |       0.49% | 324.496 us |       0.47% | -0.052 us |  -0.02% |   SAME   |
|  I128   |      I32      |      2^16      |  11.451 us |       4.65% |  11.439 us |       3.22% | -0.011 us |  -0.10% |   SAME   |
|  I128   |      I32      |      2^20      |  15.416 us |       1.42% |  15.419 us |       1.53% |  0.002 us |   0.02% |   SAME   |
|  I128   |      I32      |      2^24      |  66.495 us |       0.79% |  66.285 us |       1.15% | -0.210 us |  -0.32% |   SAME   |
|  I128   |      I32      |      2^28      | 634.292 us |       0.53% | 634.176 us |       0.53% | -0.116 us |  -0.02% |   SAME   |
|  I128   |      I64      |      2^16      |  11.637 us |       5.97% |  11.643 us |       5.77% |  0.006 us |   0.05% |   SAME   |
|  I128   |      I64      |      2^20      |  15.402 us |       1.39% |  15.442 us |       1.39% |  0.040 us |   0.26% |   SAME   |
|  I128   |      I64      |      2^24      |  64.799 us |       1.06% |  64.759 us |       0.81% | -0.040 us |  -0.06% |   SAME   |
|  I128   |      I64      |      2^28      | 623.543 us |       0.48% | 623.712 us |       0.56% |  0.169 us |   0.03% |   SAME   |
|   F32   |      I32      |      2^16      |  11.440 us |       3.67% |  11.481 us |       3.78% |  0.042 us |   0.36% |   SAME   |
|   F32   |      I32      |      2^20      |  12.999 us |       6.07% |  12.509 us |       7.85% | -0.490 us |  -3.77% |   SAME   |
|   F32   |      I32      |      2^24      |  24.053 us |       3.59% |  23.946 us |       2.93% | -0.107 us |  -0.45% |   SAME   |
|   F32   |      I32      |      2^28      | 177.669 us |       0.54% | 177.618 us |       0.52% | -0.051 us |  -0.03% |   SAME   |
|   F32   |      I64      |      2^16      |  11.279 us |       1.16% |  11.359 us |       2.27% |  0.080 us |   0.71% |   SAME   |
|   F32   |      I64      |      2^20      |  13.146 us |       4.69% |  12.805 us |       7.20% | -0.341 us |  -2.60% |   SAME   |
|   F32   |      I64      |      2^24      |  23.936 us |       3.28% |  23.982 us |       2.86% |  0.046 us |   0.19% |   SAME   |
|   F32   |      I64      |      2^28      | 178.063 us |       0.58% | 177.877 us |       0.57% | -0.187 us |  -0.10% |   SAME   |
|   F64   |      I32      |      2^16      |  11.317 us |       2.33% |  11.350 us |       1.86% |  0.033 us |   0.29% |   SAME   |
|   F64   |      I32      |      2^20      |  13.351 us |       1.48% |  13.390 us |       1.69% |  0.039 us |   0.29% |   SAME   |
|   F64   |      I32      |      2^24      |  38.673 us |       2.57% |  38.506 us |       2.26% | -0.167 us |  -0.43% |   SAME   |
|   F64   |      I32      |      2^28      | 324.283 us |       0.47% | 324.101 us |       0.45% | -0.182 us |  -0.06% |   SAME   |
|   F64   |      I64      |      2^16      |  11.322 us |       1.97% |  11.333 us |       1.64% |  0.011 us |   0.09% |   SAME   |
|   F64   |      I64      |      2^20      |  13.376 us |       1.67% |  13.378 us |       1.65% |  0.001 us |   0.01% |   SAME   |
|   F64   |      I64      |      2^24      |  38.632 us |       2.52% |  38.396 us |       2.09% | -0.236 us |  -0.61% |   SAME   |
|   F64   |      I64      |      2^28      | 324.640 us |       0.45% | 324.476 us |       0.46% | -0.164 us |  -0.05% |   SAME   |

@bernhardmgruber bernhardmgruber mentioned this pull request Feb 6, 2025
Merged
bernhardmgruber added a commit to bernhardmgruber/cccl that referenced this pull request Feb 7, 2025
@bernhardmgruber @gonidelis
Add b200 policies for reduce (NVIDIA#3612)
bdaabfc 
* Add b200 policies for cub.device.reduce.sum

* Add b200 policies for reduce.min

---------

Co-authored-by: Giannis Gonidelis <[email protected]>
@bernhardmgruber bernhardmgruber mentioned this pull request Feb 7, 2025
Merged
bernhardmgruber added a commit that referenced this pull request Feb 7, 2025
@bernhardmgruber
Backport to 2.8: B200 reduce tunings (#3735)
8977f79 
* Add b200 policies for reduce (#3612)
* Add b200 policies for cub.device.reduce.sum
* Add b200 policies for reduce.min
Co-authored-by: Giannis Gonidelis <[email protected]>

* Remove reduce tunings with no benefit (#3724)
Co-authored-by: Giannis Gonidelis <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@miscco miscco miscco approved these changes

@elstehle elstehle elstehle approved these changes

@gevtushenko gevtushenko Awaiting requested review from gevtushenko gevtushenko is a code owner automatically assigned from NVIDIA/cccl-cub-codeowners

@gonidelis gonidelis Awaiting requested review from gonidelis

Assignees
No one assigned
Labels
backport branch/2.8.x
Projects
CCCL
Archived in project
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@bernhardmgruber @gonidelis @miscco @elstehle